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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed May 29, 2002 have been fully considered but they are not 
persuasive. Applicant argues that Pintsov at col. 3, 11. 44-45 does not teach, "using the output of 
a primary recognizer as the basis for selecting a secondary recognizer"; however, Pintsov states, 
"Any particular specialist classifier [secondary recognizer] is selected based upon the probable 
identity of a candidate character as determined by the universal classifier system [primary 
recognizer]" (col. 3, 11. 47-48). Pintsov goes on to teach that the suspicious character can be 
based upon the type of character or by an assignment of a character candidate to a predefined 
group (col. 3,11. 50-60). Additionally, the universal classifier supplies the image data to the 
specialist classifier (col 3, 11. 43-45), which shows the autonomy of the specialist classifier from 
the universal classifier. If Pintsov's universal classifier truly called the specialist classifier, then 
why did Pintsov use quotation marks around "call" (col. 3, 1. 45)? In both Pintsov and the 
claimed invention, the decision to implement the specialist classifier (secondary recognizer) is 
made immediately after the character is recognized (Pintsov, "probably identity, col. 3, 11. 48) 
and the selection is based upon that identity. In addition, Pintsov teaches that several universal 
classifiers can be used to recognize a character and then a call is made to select a specialist 
classifier, which would require a post recognition determination whether the specialist should be 
called by a part of the system other than a universal recognizer (col. 3, 1. 65-coL 41 22). 

Response to Amendment 

2. The newly added claims were incorrectly numbered. Claim number 21 is missing and 
there are two claims numbered "23". The examiner has renumbered the claims to place them in 
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their proper numerical order. This did not effect the claim dependence of any of the claims. For 
purposes of examination the claims have been renumbered to be in the proper order, so claim 22 
will be referred to as claim 21 and the first occurrence of claim 23 will be referred to as claim 22 
in this office action. 

Claim Rejections - 35 USC § 103 

3. The text of those sections of Title 35, U.S. Code not included in this action can be found 
in a prior Office action. 

4. Claims 1, 2, 7, 8, 12, 20, 21 and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Pintsov, US 5881 172. 

As per claim 1, Pintsov teaches: 

providing a primary recognizer (universal classifier system, abstract, col. 2, 1 1. 7-34, col. 
20, 11. 28-54) for converting chirographs (col. 2, 1.21, "styles of handwriting" and col. 2, 11. 34- 
35) to shape indexes; applicant states in his arguments that the out put of the primary recognizer 
could be "in the form of a shape index , such as a code point" (pg. 1 1 of amendment entered into 
the file September 20, 2001), Pintsov's universal classifier outputs "machine-readable data, 
typically in ASCII form', col. 1, II. 47-49. Pintsov goes on to state that the "character may be 
recognized by the universal classifier", the recognition result inherently being in the form of a 
shape index classification or code point. 

providing a plurality of secondary recognizers ("specialist classifiers", col. 3,11, 16-18) 
to convert chirographs into code points (col. 4, 11. 10-14), and associating the secondary 
recognizers with at least some of the shape indexes ("ambiguity classes", col. 3, 1 1. 18-21), 
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receiving a chirograph (col. 1, 11. 10-11, "automated recognition of . . . handwritten 
characters"). 

providing a chirograph to a primary recognizer and receiving a shape index therefrom 
(col. 3,11. 55-60, "character candidate", Pintsov goes on to state that the "character may be 
recognized by the universal classifier", the recognition result inherently being in the form of a 
shape index classification or code point.). 

Pintsov does not teach, other than using the recognition result of the universal classifier 
(primary recognizer) to select the specialist classifier (secondary recognizer), that the specialist 
classifier without farther decision by the primary recognizer. Pintsov discloses that the universal 
classifier "calls" the specialist classifier. By using quotes it is ambiguous as to whether Pintsov 
system does a specific call to the classifier or based upon the output of the universal classifier 
another portion of the system makes the call. But such a determination is well within the 
ordinary skill of one in the art to call the specialist classifier based on commands executed in the 
universal classifier or a part of the system that receives the output from the universal classifer 
and calls the specialist classifier. Additionally since Pintsov teaches that the selection is based 
upon the probable identity of the candidate character, the universal classifier has already made a 
decision on the character. 

without further decision by the primary recognizer, determining whether one of the 
secondary recognizers is associated with the shape index ("Any particular specialist classifier is 
selected based upon the probable identity of a candidate character... and whether the candidate 
character is 'suspicious'".), and if so, selecting that secondary recognizer as a selected secondary 
recognizer. Furthermore, in discussing figure 5, Pintsov states that one or more universal 
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classifiers are applied to the image data to generate a probable character, and then a 
determination is made to call the universal classifier (col. 3, 1. 65-col 4, 11. 22). Having possibly 
conflicting reports from each universal classifier as to call or not call seems to not be what 
Pintsov is teaching, Pintsov appears to be teaching that a determination is made to call a 
specialist classifier only after the character is recognized and determined to be part of the 
suspicious class of characters. 

It would have been obvious to one of ordinary skill in the art to use either the universal 
recognizer to call the specialist classifier or merely output a recognition result and another part of 
the system call the specialist classifier. Such decisions are made to take advantage of processing 
efficiencies of the host computer systems and also to bring to bear the full power of various 
feature extraction algorithms to accurately identify characters that may be part of a specific 
ambiguity class of characters (Pintsov, col. 3, 11. 30-35). 

As per claims 7, 20 and 23, it recites substantially the same limitations as claim 1 above 
except only broader and analogous remarks apply. 

As per claim 21, Pinto v teaches: 

wherein the shape index does not correspond to a code point (col. 3, U. 48, "probable 
identity 1 ', and col. 4, 11. 13-20, where the final output is a code). 

As per claims 2, and 8, they recite identical limitations and, therefore, the following 
remarks apply to each. 

Pintsov teaches: 

shape index comprises a code point (the output of the universal classifier is a "machine- 
readable data, typically in ASCII form 1 , col. 1,11. 47-49, or col. 3, 1 1. 55-60, "character 
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candidate", Pintsov goes on to state that the "character may be recognized by the universal 
classifier". By recognizing the character, which he teaches is usually output in ASCII form, it 
inherently follows that the value passed to the specialist recognizer would also be in ASCII 
form.)- 

As per claim 12, Pintov teaches: 
wherein the recognition result comprises a code point, (col. 1,11. 47-48). 

5. Claims 19 and 22 rejected under 35 U.S.C 103(a) as being unpatentable over Pintsov as 
applied to claims 1 and 7, further in view of Shimizu et al. (hereinafter Shimizu, US 6038343). 

As per claims 19 and 22, Pintsov teaches that his specialist classifiers are called when a 
character is determined to be suspicious (col 4, 1. 10-22). However, Shimizu teaches: 

wherein each shape index that the primary recognizer (fig. 1, element 1 1) is capable of 
outputting has a unique secondary recognizer (fig. 1, element 17) associated therewith. 

It would have been obvious to one of ordinary skill in the art to use the writer specific 
feature vectors of Shimizu to augment the system of Pintsov to increase the ratio of a character 
recognition system employing a universal recognition dictionary without requiring that special 
operations be performed before character recognition is performed on the handwriting of a new 
writer (Simizu, col. 2, 11. 17-22, col. 3, 11. 1-6). 

6. Claims 13-15, 17, 24 and 25 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Pintsov as applied to claims 1 and 7, further in view of Crane, US 4,53 1,23 1 . 

As per claim 13, it recites substantially the same limitations as claim 1 above except only 
broader and analogous remarks apply. Claim 13 does have two different limitation that requires 
further explanation. Pintsov teaches that his recognition system can be used for automated 



Application/Control Number: 09/528,889 Page 7 

Art Unit: 2623 

recognition of handwritten characters (col 1,11. 10-11), but he does not specifically state an 
interface means for accepting a handwritten character data. Pintsov teaches accepting image data 
from some device (see figure 4, element 3). The claim recites that the use of an "interface 
configured to receive a chirograph", Crane teaches an interface (see figs. 1 elements 12 and 14). 
It would have been obvious to one of ordinary skill in the art to utilize the handwriting input 
means of Crane in the system of Pintsov to provide a registration means so that Pintsov could 
accept handwritten characters so that Pintsov could utilize his method of automated handwriting 
recognition. Additionally, the Crane reference is used to illustrate that such an interface feature is 
well-known in the art of computer-based handwriting recognition. 

The second limitation is partially addressed by the comments with respect to a similar 
limitation in claim 1 however, the selection mechanism in not completely disclosed, however, 
Pintsov teaches: 

a selection mechanism that selects a selected secondary recognizer based on the shape 
index, without further decision by the primary recognizer (col. 3, 1. 65-col. 4, 1. 22). 
As per claim 14, Pintsov teaches: 

shape index comprises a single code point (the output of the universal classifier is a 
"machine-readable data, typically in ASCII form*, col. 1, 11. 47-49 or col. 3, 11. 55-60, "character 
candidate", Pintsov goes on to state that the "character may be recognized by the universal 
classifier". By recognizing the character, which he teaches is usually output in ASCII form, it 
inherently follows that the value passed to the specialist recognizer would also be in ASCII 
form.). 

As per claim 15, Pintsov teaches: 
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wherein the shape index comprises a single code point that differs from the returned code point 
(col. 4, 1 1. 15-23, Pintsov states, "Note that the character determined by the selected specialist 
classifier may be the same character determined as being most probable by the universal 
classifier system" (emphasis added). This statement indicates that the code point returned my 
differ from the code point provided to the specialist classifier. 

As per claims 17, they recite generally the same limitation as claim 15 except more 
broadly and analogous remarks apply. 

As per claim 24, Pintov teaches: 

wherein the shape index does not correspond to a code point (col 3, 11. 48, "probable 
identity", and col 4, 11. 13-20, where the final output is a code). 
As per claim 25, Pintov teaches: 

wherein the recognition information does not correspond to a code point, (col. 3, 11. 48, 
"probable identity") and wherein the recognition result comprises a single code point (col. 4, 11. 
13-20, where the final output is "a" code (singular)). 

7. Claims 16, 18, 26 and 27 are rejected under 35 U.S.C. 103 (a) as being unpatentable over 
Pintsov and Crane as applied to claim 13 above, and further in view of Guo et al. (Guo), 
"Classification trees with neural network feature extraction", Proceedings IEEE Computer 
Society Conference on Computer Vision and Pattern Recognition, June 1992. 

As per claim 18, Pintsov does not teach a specific means to accept a chirograph, however, 
Crane teaches: 
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receiving a chirograph (figure 1, elements 12 and 14). Although Crane teaches providing 
the shape information to a character set discriminator (figure 1, element 16), the examiner is 
relying upon the teachings of Pintsov to teach the recognition method. 

Pintsov teaches: 

providing the chirograph (image data, figure 4, element 3) to a primary recognizes 
(universal recognizer, figure 4, element 8) and receiving recognition information therefrom a 
primary recognizer for converting chirographs to code points (col. 1,11. 47-49). determining 
whether the recognition information corresponds to a recognized result (col. 4, 1 1. 1 1-23) or has 
a value indicative [of a specialist classifier]. Pintsov teaches that the specialist classifier can be 
selected based upon any desired criteria including "assignment of a character candidate to by the 
universal classifier system to a predefined characters groups known to be ambiguous 1 ', col. 3, 1 1. 
50-60). The examiner is interpreting this portion of the disclosure to mean that the universal 
recognizer assigns a character value to the input data, such as an ASCII value for the number "4", 
his system, then looks at the predefined characters that are part of an ambiguity set, which 
includes "4" due to its resemblance to "9". Therefore, Pintsov teaches that the specialist 
recognizer is selected based upon the value returned from the universal classifier. 

and without the primary recognizer making a further decision (col. 3, 1. 65-col. 4, 1. 10). 

Pintsov does not specifically teach the use of CART trees as specialist classifiers. Pintsov 
does, however, teach that the "specialist classifiers may be implemented in any desired fashion 
using... algorithms known in the art of character recognition" (col. 3, II. 26-31). Guo teaches a 
recognition algorithm that is known in the art. 
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Guo teaches Cart trees are used to solve difficult pattern recognition problems with 
complex decision or human judgment boundaries (col. 2, second paragraph, p. 183). Guo also 
teaches that a decision rule is associated with a tree col. 1, second paragraph, p. 184 

Pintsov teaches the structure of the following claims and Guo teaches the use of a CART 

tree: 

determining whether the recognition information corresponds to a recognized result or 
has a value indicative of a CART tree being associated therewith (Pintsov, col. 3,11. 50-60, 
Guo, section 4.2); 

if the recognition information corresponds to a recognized result, and if the recognition 
information has the value indicative of the CART tree being associated therewith, providing 
chirograph information to the CART tree and returning a recognition result wherefrom, the 
recognition being independent of the value indicative of the CART tree. (Pintsov, col. 4, 11.4- 
22, Guo, section 4.2). 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to integrate methodology of the CART algorithm with respect to handwriting as taught by Guo 
as a result of the optimization of the splitting criterion and the use of the Gini criterion as a 
specialist classifier in the system of Pintsov to bring the full power of the CART algorithm as 
taught by GUO to bear on the specific ambiguity class to provide a more accurate result. 

As per claim 16, it simply recites the use of a CART tree as a secondary recognizer and 
the remarks in rejecting claim 18 above apply to those claims. 9. 

As per claim 26, Pintov teaches: 
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wherein the shape index does not correspond to a code point (col. 3, 11. 48, "probable 
identity", and col. 4, 11. 13-20, where the final output is a code). 
As per claim 27, Pintov teaches: 

wherein the recognition result comprises a single code point (col. 4, 11. 13-20, where the 
final output is "a" code (singular)). 

8. Claims 3-6 and 9 -1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pintsov and Crane as applied to claim 13 above, and further in view of Guo et al. (Guo), 
"Classification trees with neural network feature extraction", Proceedings IEEE Computer 
Society Conference on Computer Vision and Pattern Recognition, June 1992. 

As per claims 3 and 9, Pintsov teaches the "specialist classifiers may be implemented in 
any desired fashion using... algorithms known in the art of character recognition" (col. 3, 1 1. 26- 
31). Guo teaches a recognition algorithm that is known in the art. 

Guo teaches: 

wherein the secondary recognizer is a CART tree, (section 4.2) 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to integrate methodology of the CART algorithm with respect to handwriting as taught by Guo 
as a result of the optimization of the splitting criterion and the use of the Gini criterion as a 
specialist classifier in the system of Pintsov to bring the full power of the CART algorithm as 
taught by GUO to bring to bear the full power of various feature extraction algorithms known in 
the art of character recognition to accurately identify characters that may be part of a specific 
ambiguity class of characters (Pintsov, col. 3, 11. 30-35) by using a method that improves on 
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standard classification tree design methods by reducing the number of nodes and having a lower 
error rate (Guo, abstract) 

As per claim 4 and 10, Guo teaches: 

training the secondary recognizers by providing a first training set comprising a plurality 
of chirographs and actual code points for each chirograph (p. 185, sect. 3.1, second paragraph). 
Guo states that the pattern vectors (actual code points) and their class labels (chirograph) are at a 
given node. Further in section 4.2 he states that the handwritten character is encoded into pattern 
vectors. 

As per claims 5 and 1 1 , Guo teaches: 

wherein training the secondary recognizers further comprises determining a plurality of 
distinguishing features of the chirographs based on predetermined criteria. Guo teaches that 
CART trees are grown by recursively finding splitting rules until it cannot be split further (p. 
184, sect. 2. 1 TREE GROWING. He further teaches in his introduction section, p. 183, that trees 
classify an input pattern through a chain of decisions. Typically decisions when flow charted are 
presented in the form of a question (e.g., Does value x exceed threshold b?). 

As per claim 6, Guo teaches: 

wherein the predetermined criteria correspond to questions, and wherein training the 
secondary recognizers further comprises determining a question ordering by measuring the 
quality of each question, (p. 185, sect. 3. 1 TREE GROWING, last paragraph of col. 1 and first 
part of col. 2.) Guo teaches that two different criteria are optimized to find a "good split", it is 
obvious in the use of CART trees that a quality question would result in a "good split". 

Conclusion 
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9. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 . 1 36(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

10. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Martin Miller whose telephone number is (703) 306-9134. The 
examiner can normally be reached on Monday-Friday, Maxi-flex. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (703) 308-6604. The fax phone numbers for the 
organization where this application or proceeding is assigned are (703) 872-9314 for regular 
communications and (703) 872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-3900. 





